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* Motivation 
e [mage formation 


e Vignetting and exposure estimation 


Results 


e Summary 
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Motivation 








* Determination of vignetting and exposure 


Traditional approach 
- Flatfield + camera response calibration in 
the lab 


Simpler: use overlapping images 


Applications 
- spatial & photometric mosaicing 
- Recovery of scene radiance, required © 
for radiometric reconstruction methods 
(Shape from Shading, Photoconsitency) 
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Image formation 











e] 





Radiance L in| Irradiance / in ka 


A m” 


e Image irradiance:/=7 M L k aperture value 


M vignetting function 


e Natural vignetting: M = cos“ 0 
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Image formation 








Integration 
stl 
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Pixel values B 
Camera response 
Radiance L [—] Irradiance / [3] = ME) in [colour levels] 
in image plane | 
e [nte eration On Sensor e—st-; effective exposure 
e Used model M vignetting function 
W. white balance factor 


channel number 
aperture value 
camera sensitivity 
integration time 





S ho mr t€. 
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Natural vignetting 











* Light falloff due to 
- Apparent area of exit pupil, cos(b) 
- Larger effective area on film, cos(b) 
- Larger distance to image corner, 
cos'(b) 


e Natural vignetting not reduced by | b N SL 


stopping down 


* Lenses are complicated, 
cos“ does not apply for many designs 





© Paul van Walree 
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Sensor 





Optical vignetting 








e Entrance pupil shaded 
by lens barrel 


e Optical vignetting 
depends on aperture 





f 1.4 f 5.6 


© Paul van Walree 
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Mechanical vignetting 











* Light 1s blocked by lens hood, or other objects 


e Results in unrecoverable 
vignetting 





© Paul van Walree 
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Vignetting of a real lens 
Flatfield image 











e Image of a homogeneous white surtace 





e ()bservation 


— Radial falloff 
— Not centred 








Image by Goldman and Chen (2005) 
Contrast enhanced and quantized for better visibility on a beamer 
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Modelling vignetting 








e Non-Parametric models 
- Flatfield image 


* accurate 
e acquisition cumbersome 


e Parametric models 
— Radial polynomial model 


M-p,r'-B,r'-B,r 41 


- Allow center shift c 
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Modelling the 
camera response 











* Non-Parametric 
- Can model all shapes 
- Dense data required 


e Parametric 
- Polynomial 
e Less parameters 
e Dense data reguired 
- PCA basis of 201 response functions (Grossberg, Nayar) 
e First 3 Eigenresponses describe all 201 functions well. 
e Strong model, can be used with sparse data 
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Grey value transfer function 








e Scene points imaged in registered 
Images 





* Joint histogram : 
— cannot model vignetting is 


* Gray value transfer function 
e, M (x;)f (By) 
B,=T(B,)=f( | 


e, M (x,) 
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Estimation using 
corresponding points 











e Estimation of the transfer function by minimising 
e=d(B,-T(B,)) 
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e Other approaches (Goldman 05) 


- Alternating minimisation steps of 
e=}, d(B,—f(eM L,)) 


for L and eM.f 
- Large number of variables 
- Slow convergence 


d distance metric 
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Estimation using 
corresponding points 











e Estimation of the transfer function by minimising 
e=d(B,-T(B,)) 


e Symmetric transfer error: 
e,2d(B,—1(B,)) * d(B,—T(B,)) 





e Minimising e using a set of (B, B.) measurements 
S 


yields 
- Exposure, vignetting, white balance 


- Camera response d distance metric 
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The exponential ambiguity 








e Simultaneous estimation of exposure and camera 
response subject to exponential ambiguity 


e Calibration and Radiometry 
— Either camera response or exposure need to be known 


e Removal of exposure, vignetting and WB 
differences 
- Find any solution, correct images 


— Use inverse response to transform into original grey 
value space 
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Extraction of 
corresponding points 














e Avoid outliers due to misregistration 
- Extract points in low gradient areas 

e Need points at all radii r 
- Bin points by distance from image centre 
- Select points with lowest gradients 

















a E all D, extracted di 
correspondences correspondences 
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Evaluation 
Synthetic example 











e Simulated panorama with 6 overlapping images 


- Gaussian noise (2 grey values), quantisation, outliers 
- Estimate vignetting and exposure, 


analyse error to ground truth 


Squared error 
Huber M-estimator 


n 
2 
2 1 
7 
È 
HW 


Exposure RMSE 


Squared error 
Huber M-estimator 
300 points 


Ü 20 30 
Outliers [%] 





200 300 400 500 600 700 
Number of corresponding points 








Pablo d'Angelo CCMVS 2007 






Venice 
Vignetting correction 
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Green Lake — È 
Vignetting, exposure and WB correction Lhe 








Original images 





Corrected Im 


MA 
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Green Lake = 
Results Goldman & Chen PY 











proposed method 
k gs TESS a ON TT 
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pherical panorama 
Original images 
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Spherical panorama 


Vignetting, exposure and WB correction 
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Summary and conclusion 








e Estimation of radiometric camera parameters from 
overlapping 1mages 
- exposure, vignetting, response curve, white balance 
- Robust approach, better results than previous methods 
- Compact parametrisation, fast estimation 
e Applications 
- Radiometric calibration, estimation of scene radiance 


- Removal of photometric distortions from image 
mosaics 


e Implemented in Hugin, http://hugin.sf.net 
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Radiometric alignment 
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and vignetting calibration 
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Evaluation 
Image blending 
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